Papers with novelty detection
Evaluating Research Novelty Detection: Counterfactual Approaches (D19-53)
Copied to clipboard
| Challenge: | Despite its importance, this direction of research has not been explored as much. |
| Approach: | They propose to use counterfactual simulations to evaluate paper novelty detection models . they ask models to differentiate papers at time t and counterf actual paper from future time . |
| Outcome: | The proposed models can be compared against a set of papers with a given date and with different annotations. |
Novel Feature Discovery for Task-Oriented Dialog Systems (2023.findings-eacl)
Copied to clipboard
| Challenge: | Prior work on novelty detection limits the scope of features represented by novel single intents to those represented by multiple user-perceived fine-grained features belonging to the same intent. |
| Approach: | They propose to use a feature discovery technique to discover novel features from user utterances rather than single intent discovery to classify them into slots. |
| Outcome: | The proposed approach consistently detects novel features from user utterances on two datasets. |
NovAScore: A New Automated Metric for Evaluating Document Level Novelty (2025.coling-main)
Copied to clipboard
Lin Ai, Ziwei Gong, Harshsaiprasad Deshpande, Alexander Johnson, Emmy Phung, Ahmad Emami, Julia Hirschberg
| Challenge: | Recent research has focused on identifying text that introduces new, previously unknown information, but has seen a decline in novelty detection due to the rise of large language models. |
| Approach: | They propose a novel automated metric for evaluating document-level novelty that aggregates the novelty and salience scores of atomic information and provides high interpretability and a detailed analysis of a document's novelty. |
| Outcome: | The proposed metric scores high on the TAP-DLND 1.0 dataset and a human-annotated dataset. |